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DETAILED ACTION 

1 . This action is responsive to communications: the application filed on 9/1 1/03, and 
the IDSs filed on 1/28/04 and 2/25/04, foreign priority 3/13/03. 

2. Claims 1-7 are pending in the case. Claims 1, 5-7 are independent claims. 

Priority 

3. Receipt is acknowledged of papers submitted under 35 U.S.C. 1 19(a)-(d), which 
papers have been placed of record in the file. 

Claim Objections 

4. Claim 3 is objected to since the arrangement of the limitations is rather 
confusing. It is suggested the claim be changed as follows: 

A user-data relating apparatus according to claim 1, further comprising: 

- an extracting unit for extracting the user data from a read material image data 
wherein the user data is an item which was annotated in a printed material by the 
user and the input unit is an image reading apparatus for reading the printed 
material 

- the relating unit for further causing the user data to be related to the position 
contained in the continuous data in which the material was employed based upon 
a corresponding relationship between the material related to the extracted data 
and the material employed while the continuous data is recorded 
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Claim Rejections - 35 USC § 102 

5. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

6. Claims 1-7 are rejected under 35 U.S.C. 102(e) as being anticipated by Chiu et 
al. (US 7,051,271, 5/23/06, 5/31/00). 

The applied reference has a common assignee with the instant application. 
Based upon the earlier effective U.S. filing date of the reference, it constitutes prior art 
under 35 U.S.C. 102(e). This rejection under 35 U.S.C. 102(e) might be overcome 
either by a showing under 37 CFR 1 .132 that any invention disclosed but not claimed in 
the reference was derived from the inventor of this application and is thus not the 
invention "by another," or by an appropriate showing under 37 CFR 1 .131 . 

Regarding independent claim 6, Chiu discloses: 

- accepting the user data added by the user with respect to a material which has 
been distributed to the user in relation to the material actually used in the 
continuous data (col 3, lines 44-50, col 4, lines 16-42, col 6, line 39 to col 7, line 
9: the annotation performed by the user, is the user data added to the paper 
handout, which is the material, distributed to the user in the meeting event, used 
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in the video recorded during the event; performing such annotation on the 
handout shows that the annotation added by the user is received or accepted) 

- causing the user data to be related to a position contained in the continuous data 
in which the material was employed based upon a corresponding relationship 
between the material to which the user data has been added and the material 
employed while the continuous data is recorded (col 7, lines 1-13: the fact that 
the ink stroke annotation on the handout may be hyperlinked to play their 
corresponding segment in the video recording implies that the annotation is 
caused to be related to a position contained in the continuous data via the 
corresponding segment in the video recording; also in col 5, line 62 to col 6, line 
27) 

Regarding independent claim 7, Chiu discloses: 

- extracting user data which was described by the user with respect to a material 
distributed to the user by reading an image of a printed material (col 7, lines 1-13, 
col 6, lines 46-67, col 4, lines 36-42: extracting the user ink stroke annotation 
from the handout data) 

- causing the user data to be related to the continuous data in which the material 
was employed based upon a corresponding relationship between the material in 
which the extracted user data has been described and the material employed 
while the continuous data is recorded (col 7, lines 1-13: linking between the 
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segment in the video recorded in which the handout was employed, and wherein 
the handout the extracted user data is described) 

Claims 1 and 5 are for an apparatus and a program of the corresponding method claim 
1 , and are rejected under the same rationale. 

Regarding claim 2, which is dependent on claim 1, Chiu discloses specifying both 
material employed while the continuous data is recorded and the position contained in 
the continuous data in which the material was employed (col 5, line 62 to col 6, line 15, 
46-67: the handout employed in the video recorded in the event and the segment, which 
means the position of this segment, of the video recorded during the event related to the 
handout are specified) 

Regarding claim 3, which is dependent on claim 1, Chiu discloses: 

- extracting the user data from the read material image data (col 7, lines 1-13: 
extracting the user ink stroke annotation from the handout data) 

- causing the user data to be related to the position contained in the continuous 
data in which the material was employed based upon a corresponding 
relationship between the material related to the extracted data and the material 
employed while the continuous data is recorded (col 7, lines 1-13: linking 
between the segment in the video recorded in which the handout was employed, 
and wherein the handout the extracted user data is described) 
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Regarding claim 4, which is dependent on claim 1, Chiu discloses synchronizing the 
continuous data with the user data to reproduce both continuous data and the user data 
synchronized with the continuous data based upon the relating information acquired by 
the relating information (col 7, lines 1-13, figure 5, col 2, lines 15-59). 

Conclusion 

7. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Rangan et al. (US 6,493,872). Lord et al. (US 6,842,190). 

Kang (US 2001/0014210). Wilcox et al. (US 2002/0027976). 

Chou (US 2003/0124502). Wallace et al. (US 2004/0034869). 

Denoue et al. (US 2004/0021685). Kumar et al. (US 2006/0008152). 

Kang (US 2006/0140592). Chiu et al. (US 2006/0143567). 

Spielberg et al. (US 2006/0143559). Hull et al. (US 2007/0038935). 

Costa et al., Annotation as Multiple Perspectives of Video Content, ACM 2002, pages 

283-286. 

Sastry et al., Webtour: A System to Record and Playback Dynamic Multimedia 
Annotations on Web Document Content, ACM 1999, pages 175-178. 
Hurst et al., A Synchronization Model for Recorded Presentations and its Relevance for 
Information Retrieval, ACM 1999, pages 333-342. 

Chiu et al., LiteMinutes : An Internet-Based System for Multimedia Meeting Minutes, 
ACM 2001, pages 140-149. 



Application/Control Number: 10/659,307 



Art Unit: 2178 



Page 7 



8. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Cong-Lac Huynh whose telephone number is 571-272- 
4125. The examiner can normally be reached on Mon-Thurs (9:00-7:00). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Stephen Hong can be reached on 571-272-4124. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



Cong-Lac Huynh 
Primary Examiner 
Art Unit 21 78 
6/7/07 




